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Description 

Method for determining the current position of the heads of 
vehicle occupants 

The present invention relates to a method for determining the 
current position (A, B, C, D ...) of a head of an occupant in 
the passenger compartment of a motor vehicle, said head moving 
toward a dynamic disabling zone in front of an air bag module. 



Future restraint systems in motor vehicles will have to take 
into account the current position of the heads of vehicle 
occupants, in order to achieve the optimum protective effect 
during airbag activation. These developments are also driven 
15 by legislative initiatives, for example in the US by 
legislative initiative FMVSS 208. 

A important element of such legislation is the automatic 
dynamic disabling zone in front of the airbag module 

20 (hereafter referred to as the critical out of position zone or 
COOP. The limit of this zone is typically located at a 
distance of around 10cm from the airbag module toward the 
occupant. If during an accident (e.g. as a result of total 
brake application) the head of the vehicle occupant is thrown 

25 toward the airbag module, the legislation requires the airbag 
to be disabled before the head- or torso enters the COOP zone. 
A critical factor here is the distance from the part of the 
head (generally the face) or torso (generally the chest) 
facing the airbag to the airbag module. 

30 

An important criterion for optimizing this function is the 
size of the so-called switch zone. On the one hand the airbag 
must be deactivated before the head enters the COOP zone but 
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on the other hand the occupant must not be denied any 
protection potential at an adequate distance from the airbag. 
The switch zone should therefore be as small as possible. The 
size of the switch zone is typically around a few centimeters. 



Contactless systems and primarily optical systems have been 
developed to measure the distance of the head of the occupant 
from the airbag module. These optical systems are preferably 
3D cameras, which operate according to the stereoscopic 
10 method, the pencil of light method or TOF (time of flight) . 

Such image acquisition units are typically integrated up in 
the roof module between the vehicle seats (see Figures 1 and 2 
below) . The advantage of this integration position is that 

15 under normal circumstances the camera cannot easily be 
covered, e.g. by occupants reading newspapers. One 
disadvantage is however that when the head enters the COOP 
zone, the camera cannot see the part of the head facing the 
airbag module, i.e. generally the face. In this instance the 

20 image acquisition unit is looking at the back of the 
occupant ' s head . 

It is known that this problem can be resolved by assuming a 
mean head size. However this assumption is subject to not 
25 insignificant error in the case of bouffant hairstyles, head 
coverings, etc. The assumption no longer applies in such 
cases. The switch zone must therefore be big enough to cover 
most scenarios given this uncertainty. 



5 



30 Figure 3 illustrates this situation. In head position A 

(seated normally) the camera sees the face of the occupant but 
not the hair. In head position B (face at limit of COOP zone) 
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the camera looks at the back of the occupant's head and sees 
the hair but no longer the face of the occupant. 

Figure 4 shows that if a mean head size is assumed, even a 
5 slightly bouffant hairstyle can result in the camera 

determining a position outside the COOP even though the head 
has already entered the COOP. 

The object of the invention is to specify an improved method, 
10 which avoids the above disadvantages, and a device for the 
exact determination of the position of the heads of vehicle 
occupants. In particular the invention should allow the 
smallest possible switch zone to be achieved, so as not to 
deny the occupant any protection potential at an adequate 
15 distance from the airbag module. 

This object is achieved by the independent claims. 
Advantageous embodiments and developments, which can be 
deployed individually or in combination with each other, are 
20 set out in the dependent claims. 

A first method according to the invention for determining the 
exact position (A, B, C, D ...) of a head of an occupant in the 
passenger compartment of a motor vehicle, said head moving 

25 toward an automatic dynamic disabling zone in front of an 

airbag module, using an image acquisition unit with an ideal 
line of sight, which is essentially perpendicular to the ideal 
direction of movement of the occupant, is characterized in 
that the image acquisition unit is used at least cyclically to 

30 record an image scenario including the occupant, i.e. an image 
area including the occupant, in the passenger compartment of 
the motor vehicle and to detect image information relating to 
the occupant; in the respective current scenario image both 
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the position of the geometric center of the head and the 
apparent size of the head are determined^ in particular 
measured in the direction of movement; the respective current 
lines of sight of the image acquisition unit are defined as a 
5 vector from a defined position of the image acquisition unit 
to the respective current position of the geometric center of 
the head; the respective current angle a between the ideal 
line of sight and the current lines of sight of the image 
acquisition unit are calculated; the respective current values 
10 for angle a and apparent size of the head are stored in a 

storage unit; and the value from the storage unit for which 
the absolute sum of the difference between angle a and 0° was 
minimal is always assumed to be the size of the head. 

15 Contrary to the prior art therefore instead of a mean head 

size, an apparent and therefore ultimately real head size is 
determined. Then during the for example parallel position 
calculations the head sizes, which are closest to the actual 
head size and in the best instance may even correspond to it, 

20 are selected from the set of head sizes thus determined and 

used as the basis for calculation. Using a head size based on 
reality for determination of the current position in front of 
the airbag module advantageously gives a much more exact 
position determination than is possible with the prior art and 

25 therefore allows a significantly smaller switch zone to be 

achieved, thereby increasing the protection potential for the 
occupant of the vehicle. 

The present invention also relates to a method for determining 
30 the exact position (A, B, C, D ...) of a head of an occupant in 
the passenger compartment of a motor vehicle, said head moving 
toward an automatic dynamic disabling zone in front of an 
airbag module, using an image acquisition unit with an ideal 
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line of sight, which is essentially perpendicular to the ideal 
direction of movement of the occupant, the image acquisition 
unit being used at least cyclically to record an image 
scenario including the occupant, i.e. an image area including 
5 the occupant, in the passenger compartment of the motor 
vehicle and to detect image information relating to the 
occupant; both the position of the geometric center of the 
head and the apparent size of the head being measured in the 
direction of movement in the respective current scenario 

10 image; the respective current lines of sight of the image 
acquisition unit being defined as a vector, from a defined 
position of the image acquisition unit to the respective 
current position of the geometric center of the head; the 
respective current angles (3 between the direction of movement 

15 of the head and the current lines of sight of the image 

acquisition unit being calculated; the respective current 
values for angle p and the apparent size of the head being 
stored in a storage unit; and the value from the storage unit 
for which the absolute sum of the difference between angle j3 

20 and 90° was minimal being assumed to be the size of the head. 
This method also has the advantages mentioned above. 

In a preferred embodiment of the invention the image 
acquisition unit is a 3D camera, which operates according to 

25 the stereoscopic method, the pencil of light method, the time 
of flight method or another equally appropriate method: Use of 
a 3D camera, in particular in respect of the last mentioned 
method according to the invention, advantageously allows 
determination of the current position independently of ideal 

30 movement directions and/or lines of sight based on actual 
movement vectors in three-dimensional space. 
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Instead of carrying out a position determination based on an 
ideal direction of movement, it is therefore preferably 
proposed according to the invention that the respective 
current angle P is calculated between a current actual 
5 movement vector of the head and the current line of sight 
vector of the image acquisition unit. This advantageously 
enhances the reliability of the method according to the 
invention even when an occupant is sitting with a lateral 
orientation, as for example occurs normally when looking out 
10 of a side window, etc. 

Because the respective last or previous value for the position 
of the geometric center of the head is preferably stored, the 
respective current movement vector can advantageously be 
15 calculated in a simple manner from the stored last and the 
current 3-dimensional positions of the head. 

According to the invention the defined position of the image 
acquisition unit is preferably based on the center of a lens 
20 aperture of the image acquisition unit, in the case of the 
stereo camera for example the left lens. 

In a further preferred embodiment of the invention, the image 
acquisition unit records images of the relevant scene 
25 continuously, at least 25 images per second, in particular at 
least 30 images per second, preferably at least 35 images per 
second, so that film speeds, i.e. online viewing, can actually 
advantageously be achieved. 

30 The size of the storage unit is such that at least all the 
measured values of a slow head movement from a first head 
position (A), i.e. an initial position, to the relevant second 
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head position (B) , namely the position with the face at the 
limit of the COOP area, can be stored. 

In one expedient embodiment of the invention the storage unit 
5 is a ring buffer store, which is first filled and from then on 
the oldest value is replaced by the current value. 

It has also proven advantageous for the recordings of the head 
movement to be filtered using filters such as Kalman filters 
10 and/or movement models. 

It should be noted specifically that instead of determining 
the head position, with the image acquisition unit any other 
appropriate part of the body of an occupant can be used as the 
15 basis for calculating the position of said occupant, such as 
in particular the size of the torso of the occupant in the 
motor vehicle. 

In a further preferred embodiment of the invention it is 
20 proposed that different views of the occupant be combined to 
provide a 3D overall view of the person. This advantageously 
allows simulation for example of the front or facial profile 
of the occupant in front of the plane of the COOP limit from 
the overall view and therefore more accurate calculation of 
25 its distance from the disabling zone or the airbag module than 
with" the prror art. 

For the sake of completeness, it should be pointed out that 
the invention also of course relates to a device corresponding 
30 to the method for determining the current position (A, B, C, D 
...) of a head of an occupant in the passenger compartment of a 
motor vehicle, said head moving toward an automatic dynamic 
disabling zone in front of an air bag module, said device 
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being characterized by appropriate means for carrying out the 
method as described above. 

Particular problems relating to the legislative initiative 
5 FMVSS 208 mentioned above are known to be posed by the 
validatability and reproducibility of the head position 
measurements in the context of the licensing procedure for a 
camera system. By improving the head position determination 
even by a matter of centimeters, the present invention can 
10 offer crucial advantages both here and in the field. By 
advantageously enhancing the protection potential of an 
occupant in a motor vehicle thus, the present invention is in 
particular suitable for occupant protection systems in modern 
motor vehicles. 

15 

The invention is described below with reference to different 
exemplary embodiments and in conjunction with the drawing, in 
which: 

20 Figure 1 shows a schematic diagram of a top view of a typical 
integration location for an image acquisition unit in the 
passenger compartment of a motor vehicle; 

Figure 2 shows a schematic diagram of a side view of the 
25 integration location according to Figure 1; 

Figure 3 shows a schematic diagram of the measurement of the 
head positions of an occupant assuming mean head sizes; 

30 Figure 4 shows a schematic diagram of the incorrect 

measurement based on the assumption according to Figure 3 of 
the head positions of an occupant with a bouffant hairstyle 
for example; 
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Figure 5 shows a schematic diagram of a first exemplary 
embodiment of the measurement of head positions according to 
the invention; and 

5 

Figure 6 shows a schematic diagram of a second exemplary 
embodiment of the measurement of head positions according to 
the invention. 

10 Figure 1 shows a top view of the typical integration location 
of an image acquisition unit 16 in the passenger compartment 2 
of a motor vehicle 1. 

Figure 2 shows a side view of the diagram in Figure 1. 

15 

An image acquisition unit 16, for example a 3D camera, is 
generally integrated in a module up in the roof liner 20 
between the vehicle seats 3. An airbag module 5 is housed in 
front of the seats 3, typically in the dashboard 4. An 

20 automatic dynamic COOP disabling zone 6 in front of the airbag 
5 serves for the statutorily required protection of an 
occupant 8 from injury by the airbag 5, if a minimum distance 
therefrom is not observed. The advantage of the integration 
location 20 described above for the camera 16 is that under 

25 normal circumstances it cannot easily be covered, for example 
by occupants 8 reading newspapers. It is however a 
disadvantage that when the head 9 enters the COOP zone 6; the 
camera 16 cannot see the part of the head 9 facing the airbag 
module 5, generally the face 12. In this instance the camera 

30 16 is looking at the back of the head of the occupant 9. 

It is known that this problem can be resolved by assuming a 
mean head size. This assumption is however subject to not 
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insignificant error in the case of bouffant hairstyles, head 
coverings, etc. The assumption no longer applies in such 
cases. A switch zone 7 in front of the COOP zone must 
therefore be big enough to cover most scenarios given this 
5 uncertainty. 

Figure 3 illustrates this situation, i.e. the measurement of 
head positions of an occupant 8 assuming mean head sizes. In 
head position A (seated normally) the camera 16 sees the face 
10 12 of the occupant but not the hair. In head position B (face 
at limit of COOP zone) the camera 16 looks at the back of the 
head of the occupant 8 and sees the hair but no longer the 
face 12 of the occupant 8 . 

15 Figure 4 shows the incorrect measurement based on the 

assumption according to Figure 3. If a mean head size is 
assumed, even a slightly bouffant hairstyle can result in the 
head 9 entering the COOP zone 6 but the camera still 
determining a position outside the COOP zone 6. 

20 

Figure 5 shows a first exemplary embodiment of the measurement 
of head positions according to the invention in principle. To 
this end the size 11 of the head 9 of the occupant 8 is 
determined or measured as accurately as possible, particularly 

25 at head position C. The invention hereby utilizes the idea 

that the best position for a measurement with regard thereto 
is the point in space, at which the ideal direction of 
movement 14 of the head 9 is perpendicular to an ideal line of 
sight 17 of the camera 16. The measurement is then preferably 

30 carried out when the geometric center 10 of the head 9 crosses 
this point. 
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A method for determining the current size 11 of the head 9 for 
example implemented in an algorithm can for example be as 
follows : 

5 Known methods of image processing are used in the respective 
current 3D image to measure the position of the geometric 
center 10 of the head 9, as well as the apparent size 11 of 
the head 9 in the direction of movement 14 . 

10 The current line of sight 18 of the camera 16 is defined as a 
vector, from a defined camera position 19, for example the 
center of the lens aperture, in the case of a stereo camera 16 
for example the left lens, to the position of the geometric 
center 10 of the head 9, 

15 

A current angle a between the ideal line of sight 17 and the 
current lines of sight 18 of the 3D camera 16 is then 
calculated according to known methods of linear algebra. 
Alternatively or even cumulatively as a plausibility check for 
20 example, a current angle P can be calculated between the ideal 
direction of movement 14 of the head 9 and the current lines 
of sight 18 of the image acquisition unit 16. 

The respective current values for angles a and p and apparent 
25 head size 11 are then stored, preferably in a ring buffer 
store (not shown), in which the oldest value is always 
replaced by the current value. The size of the ring buffer 
store is preferably dimensioned such that at least all the 
measured values of a slow head movement 14 from head position 
30 A to head position B can be stored. 

The value from the current ring buffer store for which the 
absolute sum of the difference between angle a and 0° or angle 
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(3 and 90^ was minimal is always assumed to be the size of the 



Figure 6 shows a second exemplary embodiment of a preferred 
5 measurement of head positions according to the invention. 

First known image processing methods are used in the 
respective current 3D image to measure the position of the 
geometric center 10 of the head 9, as well as the apparent 
10 size 11 of the head 9 in the direction of movement 14. 

The current line of sight 18 of the camera 16 is also defined 
as a vector, from a defined camera position 19, for example 
the center of the lens aperture, in the case of a stereo 
15 camera 16 for example the left lens, to the position of the 
geometric center 10 of the head 9. 

Unlike in Figure 5, the respective last, i.e. previous, values 
are now stored for the position 10, so that an actual movement 
20 vector 15 of the head 9 can be calculated from the stored last 
and current 3-dimensional head position 10. 

The current angle 3 between the actual movement vector 15 of 
the head 9 and the current lines of sight 18 of the 3D camera 
25 16 are then calculated according to known methods of linear 
algebra. 

The respective current values for angle (3 and apparent head 
size 11 are then stored, again preferably in a ring buffer 
30 store (not shown) , in which the oldest value is always 
replaced by the current value. 



head. 



2003P06590WOUS 



PCT^K^2004/050411 



13 

The value from the current ring buffer store for which the 
absolute sum of the difference between angle p and 90*^ was 
minimal, i.e. the geometry was closest to the "'perpendicular" 
condition, is always assumed to be the size of the head. 

5 

It should be noted that the methods described above can be 
stabilized further by further measures. For example the head 
movement 14 or 15 can be filtered using known filters and 
movement models (Kalman filters) • 

10 

The above methods can also advantageously be applied 
correspondingly to the determination of the distance of the 
torso 13 of the occupant from the airbag module 5. The size of 
the torso 13 of the occupant 8 is then detected using the 3D 
15 camera instead of the size 11 of the head 9. 

The above methods can be developed still further by combining 
the different views of the person 8, which result from the 
different positions A, B, C, ... of the person 8 in relation to 
20 the camera 16, to form a three-dimensional overall view of the 
person 8, e.g. front view A with person sitting normally plus 
side view C with person 8 next to camera 16 plus rear view B 
with person 8 bending. 

25 All partial views A, B, C, D, recorded during the forward 
movement of the person 8 by the 3D camera 16 and buffered in 
the ring buffer store, can also be used for the combination of 
partial views A, B, C, ... of the person 8. 

30 When the person 8 is close to the COOP zone 6, practically 
only the rear of the person is visible to the 3D camera 16. 
The non-visible front 12 of the person 8 can now be simulated 
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from the overall view determined above and the distance from 
the airbag module 5 can be calculated more accurately. 

The present invention advantageously enhances the protection 
5 potential of an occupant 8 in a motor vehicle 1. It is 
therefore suitable in particular for occupant protection 
systems in modern motor vehicles 1. 
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Claims 

1. Method for determining the current position (A, B, C, D 
...) of a head (9) of an occupant (8) in the passenger 
5 compartment (2) of a motor vehicle (1), said head (9) moving 
toward an automatic dynamic disabling zone (6) in front of an 
airbag module (5), using an image acquisition unit (16) with 
an ideal line of sight (17), which is essentially 
perpendicular to an ideal direction of movement (14) of the 
10 occupant (8), in which 

- an image scenario in the passenger compartment (2) of the 
motor vehicle (1) including the occupant (8) is recorded at 
least cyclically using the image acquisition unit (16) and 
image information relating to the occupant (8) is detected; 

15 - both the position of the geometric center (10) of the head 
(9) and the apparent size (11) of the head (9) are determined 
in the direction of movement (14) in the respective current 
scenario image; 

- the respective current lines of sight (18) of the image 

20 acquisition unit (16) are defined as a vector, from a defined 
position (19) of the image acquisition unit (16) to the 
respective current position of the geometric center (10) of 
the head (9) ; 

- the respective current angles (a) between the ideal line of 
25 sight (17) and the current lines of sight (18) of the image 

acquisition unit (16) are calculated; 

- the respective current values for angles (a) and apparent 
size (11) of the head (9) are stored in a storage unit; 
and in which 

30 - the value from the storage unit for which the absolute sum 
of the difference between angle (a) and 0° was minimal is 
always assumed to be the size of the head (9) - 



2003P06590WOUS 



PCT 




2004/050411 



2. Method for determining the current position (A, D 
...) of a head (9) of an occupant (8) in the passenger 
compartment (2) of a motor vehicle (1), said head (9) moving 
toward an automatic dynamic disabling zone (6) in front of an 
5 airbag module (5), using an image acquisition unit (16) with 
an ideal line of sight (17), which is essentially 
perpendicular to an ideal direction of movement (14) of the 
occupant (8), in which 

- an image scenario in the passenger compartment (2) of the 
10 motor vehicle (1) including the occupant (8) is recorded at 

least cyclically using the image acquisition unit (16) and 
image information relating to the occupant (8) is detected; 

- both the position of the geometric center (10) of the head 
(9) and the apparent size (11) of the head (9) are determined 

15 in the direction of movement (14) in the respective current 
scenario image; 

- the respective current lines of sight (18) of the image 
acquisition unit (16) are defined as a vector, from a defined 
position (19) of the image acquisition unit (16) to the 

20 respective current position of the geometric center (10) of 
the head (9) ; 

- the respective* current angles ((3) between the ideal 
direction of movement (14) of the head (9) and the current 
lines of sight (18) of the image acquisition unit (16) are 

25 calculated; 

the respective current values "for angles ((3) and apparent 
size (11) of the head (9) are stored in a storage unit; 
and in which 

- the value from the storage unit for which the absolute sum 
30 of the difference between angle ((3) and 90 was minimal is 

always assumed to be the size of the head (9) - 
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3. Method according to Claim 1 or 2, 

in which the image acquisition unit (16) is a 3D camera, which 
operates according to the stereoscopic method, according to 
the pencil of light method, according to the time of flight 
5 method or another equally appropriate method. 

4. Method according to Claim 2 and 3, 

in which, instead of being based on the ideal direction of 
movement (14) of the head (9), 
10 - the respective current angles (p) between current actual 

movement vectors (15) of the head (9) and the current lines of 
sight (18) of the image acquisition unit (16) are calculated. 

5. Method according to Claim 4, 

15 in which the respective last value for the position of the 
geometric center (10) of the head (9) is stored and the 

respective current movement vector (15) is calculated from the 
stored last and the current 3-dimensional positions of the 
head (9) . 

20 

6. Method according to one of the preceding Claims, 

in which the defined position (19) of the image acquisition 
unit (16) is based on the center of a lens aperture of the 
image acquisition unit (16), in the case of a stereo camera 
25 for example the left lens, 

7. Method according to one of the preceding Claims, 

in which the image acquisition unit (16) continuously records 
images of the relevant scenario, at least 25 images per 
30 second, in particular at least 30 images per second, 
preferably at least 35 images per second. 
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8. Method according to one of the preceding Claims, 

in which the size of the storage unit is dimensioned such that 
at least all the measured values of a slow head movement from 
a first head position (A) to the relevant second head position 
5 (B) can be stored. 

9. Method according to one of the preceding Claims, 

in which the storage unit is a ring buffer store, which is 
first filled and from then on the oldest value is always 
10 replaced by the current value. 

10. Method according to one of the preceding Claims, 

in which the recordings of the head movement (14 or 15) are 
filtered by means of filters and/or movement models. 

15 

11. Method according to one of the preceding Claims, 

in which the size of the torso (13) or the size of another 
part of the body of the occupant (8) in the motor vehicle (1) 
is determined using the image acquisition unit (16) instead of 
20 the size (11) of the head (9) . 

12. Method according to one of the preceding Claims, 

in which different views of the occupant (8) are combined to 
form a 3D overall view of the person (8) . 

25 

13. Method according to Claim 11, 

in which the front of the occupant (8), in particular said 
occupant's facial profile (12), is simulated from the overall 
view and its distance calculated from the switch zone (6) or 
30 the airbag module (5) . 

14. Device for determining the current position (A, B, C, D 
...) of a head (9) of an occupant (8) in the passenger 
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compartment (2) of a motor vehicle (1), said head (9) moving 
toward an automatic dynamic disabling zone (6) in front of an 

airbag module (5), characterized by appropriate means for 
carrying out the method according to one of the preceding 
Claims . 
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